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New notions of the complexity function C(e; t, s) and entropy function ^(e; t, s) are introduced to 
describe systems with nonzero or zero Lyapunov exponents or systems that exhibit strong intermit- 
tent behavior with "flights" , trappings, weak mixing, etc. The important part of the new notions is 
the first appearance of e-separation of initially close trajectories. The complexity function is similar 
to the propagator p{to,xi.y,t,x) with a replacement of x by the natural lengths s of trajectories, 
and its introduction does not assume of the space-time independence in the process of evolution of 
the system. A special stress is done on the choice of variables and the replacement t r) = \nt, 
s — > ^ = In s makes it possible to consider time-algebraic and space-algebraic complexity and some 
mixed cases. It is shown that for typical cases the entropy function ^(e; 5, rf) possesses invariants 
(a, P) that describe the fractal dimensions of the space-time structures of trajectories. The in- 
variants (q, P) can be linked to the transport properties of the system, from one side, and to the 
Riemann invariants for simple waves, from the other side. This analog provides a new meaning for 
the transport exponent /i that can be considered as the speed of a Riemann wave in the log-phase 
space of the log-space-time variables. Some other applications of new notions are considered and 
numerical examples are presented. 

PACS numbers; 05.45.-a, 05.45.Pq 

Lead Paragraph 

It is found in many cases that Hamiltonian chaotic dynamics possesses in many cases a kinetics that doesn't obey 
the Gaussian law process and that fluctuations of the observables can be persistent, i.e. there is no any characteristing 
time of the fluctuations decay. This type of dynamics can be characterized by the so called polynomial complexity 
rather than an exponential one. More accurately, one can introduce some complexity function and entropy function 
based on the dynamical process of separation of trajectories in phase space by a finite distance during a finite time. 
The new approach to the problem of complexity and entropy covers different limit cases, exponential and polynomial, 
depending on the local instability of trajectories and the way of the trajectories dispersion. 
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I. INTRODUCTION 

The complexity of dynamical systems begins from the description of chaotic trajectories in phase space f |Hel lTil|V 
The notion of complexity has a rigorous meaning and it presents a quantity that characterizes systems and can be 
measured. In an oversimplified way one can say that the less predictable is a system, the larger complexity should be 
assigned to t he sy stem. The original version of the dynamics complexity was closely linked to the system's instability 
and entropy |IC A typical situation of the chaotic dynamics could be associated with a positive Kolmogorov- 

Sinai entropy, or be similar to the Anosov-type systems. This type of randomness and complexity of the systems can 
be characterized by the exponential divergence of trajectories in phase space. 

As long as investigation of chaotic dynamics reveals new and more detailed pictures of chaos, the simplified old 
version of the complexity appears to be constrained to be applied to typical systems. Let us mention that the 
typical Hamiltonians do not possess ergodicity, the boundary of islands in phase space make the dynamics singular 
in their vicinity, and even zero measure phase space domains in the Sinai billiard are responsible for the anomalous 
kinetics jzal| . Attempts to f ind adequate co mplexity definitions for realistic chaotic dynamics were subject to many 
publications and reviews 
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BPj . The basic idea of new developments for chaotic systems is to involve a 
finite time of the systems unstable evolution into a definition of the complexity or entropy. In some sense, our paper 
is a continuation of these attempts. 

There are numerous observations that the Hamiltonian systems referred as the chaotic ones, do not have exponential 
dispersion of trajectories for arbitrary long time intervals. These pieces of tra, iectories, called flights, appear with a 



probability that is not exponentially small (see for example |ZENl IBK WZl . IZa2l | ) . A sirn i lar type of random dy namics 
with zero Lyapunov exponent appears in billiards and maps with discontinuities f |cH . LV . ZEl . ZE2 . AFll v The 
behavior of systems with zero Lyapunov exponents definitely have some level of complexity and some value of entropy 
in a physical sense, but the same systems with zero Lyapunov exponent cannot be applied to by the regular notion of 
the Kolmogorov-Sinai entropy of the standard definitions of complexity. The most appropriate thing to say about such 
systems is that the proliferation of an indefiniteness has an algebraic dependence on time rather than the exponential 
one. Moreover, some systems behave in a mixed way: partly with an exponential growth of their enveloping (coarse- 
grained) phases volume and partly with its algebraic growth with time. 

All the above mentioned facts lead us to a necessity to introduce a new notion of complexity and entropy and this is 
the goal of this paper. Our scheme is based on a similar one to the Bowen idea of the e-separation of trajectories, which 
explicitly imposes the instability features of the dynamics. However, instead of the complexity C(e,i) we introduce 
a complexity function C{e;t,s) which is similar to a propagator p(tQ, XQ]t, x) with a replacement {xo,x) —> (0, s) 
where s is the natural length of trajectories between {xo,x). The corresponding entropy S{e;t,s) can be defined as 
lnC(e; t, s). In this form the complexity and entropy describe the system evolution in space-time without assumption 
of the space-time separation. 

Another important change is related to the choice of bas ic vari ables which can be ^ = Ins, 77 = Ini instead of (s, t). 
Similar logarithmic variable lux instead of x appeared in for a definition of entropy when Levy distributions 

is considered. We show that for some typical cases C(e;^,?/) possesses invariants (a,/?) similar to the Riemann 
invariants for the simple wave propagations. The invariants (a, /3) do not depend on e and they represent space-time 
fractal dimensions of the dynamical system. In the proposed way of description of random dynamics, the notions of 
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complexity function and entropy function appear to be constructive tools of the description of dynamics with zero or 
nonzero Lyapunov exponents, with mixing or weak mixing properties, and with normal or anomalous transport. A 
similar approach can be developed for a system with mixed features when the basic variables are (t,^) or {ri,x). In 
all considered cases the entropy is an additive function of the corresponding basic variables. 

As an important consequence of t he n ew notions, we consider directional complexity and directional entropy gen- 
eralizing the notion introduction in ^Ml^ and 
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II. PRELIMINARY COMMENTS ON THE COMPLEXITY IN PHASE SPACE 

Consider a dynamical system on the 2n-dimensional torus T^" and let the dynamics of a particle be defined by an 
evolution operator 

fit): (p(t),g(t))=t(p(0),g(0))], (1) 

which preserves the measure T{p, q) — const (phase volume), and p,q € R" are generalized momentum and coordinate. 
What kind of dynamics should be considered as a simple one and what as a complex one? We do not assume that 
there is the only definition of complexity which particularly depends on how a notion of it will be applied to the 
dynamics. A more or less typical definition of the complexity depends on how trajectories are mixed in phase space 
due to the dynamics JQ). The stronger is mixing, the more complex is the dynamics. One can immediately comment 
on some weak features of this type of approach which deals with global phase space and global mixing. The process 
of mixing can be non-uniform in time and it can have local space-different rates. We call these features of mixing as 
space-time non-uniformities and, speaking about the space, we have in mind the full phase space or its part where 
the dynamics is ergodic. 

The former comment leads us to a possibility of such definition of the complexity which could embrace non- 
uniformity of space-time dynamic processes represented by trajectories. 



FIG. 1: Dispersion of trajectories in phase space. 

Space-time non- uniformity suggests that vicinities of any trajectory considered at different points {pj,qj;tj) with 
Pj — p{tj), qj — q{tj) may have very different dynamics of trajectories (see FIG. A strong "inconvenience" of 
this conclusion becomes clear if we assume the "vicinity" as an infinitesimal ball of the radius e — > around a point 
(pj, qj] tj): it is difficult, if not impossible, to describe a trajectory finite-term behavior on the basis of the information 
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about the trajectory from an infinitesimal domain of phase space. The necessary data should arrive from finite pieces 
of trajectories which make a possible definition of complexity to be space-time non-local. We should be ready to 
have a situation with an exponential divergence of trajectories at some small parts of the phase space, and to have a 
sub-exponential divergence at other parts. 

The importance of observing a trajectory with some precision e during a finite time t was discussed in detail by 
Grassbcrgcr and Procaccia in [GP] and [P]. They also consider fluctuations of the Lyapmiov exponents obtained 
from a finite time observation. These works also presented a space-time partitioning as a way to obtain correlation 
properties of trajectories. Our analysis here will be extended, comparing to [GP] and [P], in two directions: it will be 
applied to dynamical systems that may have a sub-exponential divergence of trajectories at some phase space domains, 
and it will deal with area-preserving Hamiltonian dynamics, which permits the use of some important results on the 
Poincare recurrences. 



Here we present a brief review of a few important definitions of complexity of dynamics that involve a bunch of 
orbits and their comparable behavior in phase space. 



Historically, the first notion of complexity was introduced by Hedlund and Morse [He] for symbolic systems. Let 
{ui} = {jo,ji, . ■ . ,jN, • • •) be an admissible sequence and O = {w} be the set of all admissible sequences. One can 
say that {jk} are coordinates, a;„ := {jojji, • • • ,3n-i} is a piece of an admissible trajectory of length n, and Q. is the 
phase space. Dynamics is defined by a shift operator 



The complexity C„(a;) of an individual orbit going through a point w = u){jo,ji, . . .) is the number of different words 
{jk,jk+i, ■ ■ ■ ,jk+n) of the length n (fc > 0) in the sequence co. If we take into account that each word {jk, ■ ■ ■ ,jk+n) 
indicates a piece of the symbolic phase space, i.e. an element of the phase space partition, then C„(a;) is the number 
of different cells in the phase space available by the orbit going through the initial point oj. 

It was shown in [He] that if C„(a;) < n then uj is eventually periodic, i.e. Cn(oj) < const and, for example, there is 
no such LO that C„(a;) ~ n^/^. The complexity C„(a;) may grow exponentially with n 



III. DEFINITIONS OF COMPLEXITY IN DYNAMICAL SYSTEMS 



A. Symbolic complexity 



T{jo,jl,j2, ■■■) = (jl,j2, • • •) 



(2) 



Cn{co) ~ exp(/in) 



(3) 



and in this case h is the topological entropy. There are examples of 



(7>1) 



(4) 



i.e. of the sub-exponential complexity (see more in [Ti], [Fer], and references therein). 
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B. Topological complexity 

A transition from the symbolic complexity to the complexity of dynamical systems with arbitrary topological phase 
space was suggested in [Bla] . Let a topological space X and a continuous map /* : X ^ X 

fxo = xt , {xk e X) (5) 

generate a dynamical system (T; X), and let T) ~ (T>i, P2, ■ • ■ , 2^n) is a finite cover of the phase space by, say open, 
subsets. For any initial point xq G "Dig one can consider different itineraries {xq, . . . ,Xk — /'^xq, . . . ,Xn) such that 
Xk G Vi^ . Then the topological complexity C{T>, tn — n) is the number of different possible itineraries of the temporal 
length n for points Xk in X. Evidently, this complexity depends on the covering system J). 
If the system is chaotic, then 

C{V, n) - e''" (6) 

where h is the topological entropy provided that V is chosen in a right way. Let us emphasize that the topological 
complexity deals with all orbits of a dynamical system. 

There are other possibilities to introduce a complexity such as Kolmogorov complexity (see for example [Br]), a 
measure theoretical complexity [Ferl], etc., which will not be discussed here. 



C. e-complexity 

The definition of (e, rj)-complexity will be the most important for our following generalizations, and we discuss it 
in more detail. 
In 



KTI | the authors introduced notions of e-capacity and e-entropy in space of curves which can or can not be 
solutions of a differential equation. Let Ct — {x(t),0 < t < T}, x{t) e M be a space of continuous curves endowed 
with the following (Chebyshev) metric 

di{x{t)},{yit)}) := max^p(a;(i),y(t)) (7) 

where p is a metric in the space M. Let N{e) be the maximal number of curves which are e-pairwise d-disjoint. Then 
logiV(e) is called the e-capacity. Let iVi(e) be the minimal number of sets of d-diametcr > 2e, needed to cover the set 
C-T- Then logiVi(e) is called the e-entropy. If one assumes that {x{t)} is a piece of an orbit of a dynamical system 
and replaces the continuous time by discrete one, then one comes (as it was done by Bowen [B]) to the following 
definitions. 

Let us consider first a dynamical system generated by an evolution operator / on the phase space M. Let A C M 
be a subset of initial points (it could be invariant or not) and £n{x) = Ufc=o •^''■^ orbit segment of temporal length 
n going through an initial point x € A. Two segments £nix) and £niy), x,y A, are said to be (e, n)-separated if 
there exists k, < k < n ~ 1, such that dist(/''a;, f'^y) > e, where dist means distance in the phase space M. The 
maximal number of distinct segments of orbits with accuracy e is defined by 

Cf^n{A) = max{#segments in a (e, n) — mutually separated set} (8) 



and is said to be (e, n)-complexity of the set A. Evidently logCe.„ is the e-capacity. It was shown in [B] (see also Q 
for compact invariant subset of initial points) that 

u u f A\ r logC,,„(A) 

h = htopiA) lim lini„^oo (9) 

is the topological entropy of the dynamical system {f'^, M) on the set A, and in [T] that 

6 =: lim lime^o — ^ .^'"^ — ^ (10) 

n—too —loge 

is the upper box dimension of the set A. Thus, we may assume that if < 6 < cxd, Q < h < oo then 

C,,„(A) = e-^e''"-C(e,n) (11) 

where C{e^n) is a subexponential function of Ine and n. 

We will call the number Ce,n{A) the Bowen or (e, n)-complexity of the set A. 

The definition (jSJ is fairly general and can be applied to non-Hamiltonian and non-compact dynamics. The definition 
considers a set of orbits without details of their separation process with a time-interval n that typically is large. 

To illustrate the property 0, consider one-dimensional mixing dynamics on the interval [0,^], x G [0,£] with an 
exponential divergence of trajectories. Let 6xq is the initial distance at t = between two trajectories and 5xt = e is 
the distance at time t. Then 

e = Jioexp/it (12) 

i.e. for T > t two trajectories are separated. The number of such trajectories is 

C,AA) = ^ = ^e''' (13) 

where I a is the length of a small initial interval A. The properties JHl and follow directly from H13|) for 6=1. If 
the set A has the box-dimension 6, then H12|) should be replaced by 

(6/<5a;o)^ = e'^* (14) 

and correspondingly, instead of 113|l 

CM) = {^Al^x^f = (^A/e)'e''* (15) 
For more general situations we may assume 

Ce,t(A) = (^^/e)''e'**C(e,i) (16) 

where C(e, t) is a slow varying function of In e and t compared to the main multipliers. 

The expression (|16|) shows in an explicit way how the Bowen complexity depends on the time interval t, accuracy 
e to determine the location of trajectories, and the domain A of a set of initial conditions. The dependence on A can 
be eliminated from l|13|) or (|15|l by choosing a normalized complexity C^^i per unit volume: 

C,.* = C,M)I^\. (17) 
which is possible due to the uniformity of mixing in the considered dynamical system. 
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Remark. Complexity of an orbit. 

If one chooses an orbit r(a;o) = U^q/'^xo in the capacity of the set A of initial points, one will arrive to a definition 
of the e-complexity of the orbit r(xo). It is simple to see that this definition is an analog of the symbolic complexity 
of a symbolic system described above. 

It is not difficult to show that for any small (5 > 0, 

Ce(l+5),„(clos(r(xo))) < C,,„(r(xo)) < Ce,„(clos(r(xo))) , 

i.e., the complexity of the closure of an orbit asymptotically behaves in the same way as the complexity of the orbit. 

Furthermore making use of the definition of complexity for an arbitrary set A, one may introduce the complexity 
of a measure. 

Definition 1. Given an invariant measure fi, the quantity 

C,4^i) := inf{C,,i(A) I = 1} (18) 

A 

ia called the complexity of the measure fi. 
We shall use this definition bellow. 

D. Complexity and phase volume 

Expression © can be interpreted in a way that may be generalized to much more complicated situations. Let again 
M be the phase space, F = F(M) its phase volume, and Fq be the phase volume of a set of initial conditions Aq C M 
at time Iq — and consider their evolution At up to time t. Let Ft be a minimal enveloping At convex phase volume. 
Then for systems with exponential divergence of trajectories 

Ft - Foe''* . (19) 

To find how many different states can occupy the volume F, one should define an "elementary" minimal volume of 
one state, i.e. e^. Then 

max # states in ft = (Fo/e'')e''* (20) 

where maximum is considered with respect to different sets A in Fg. 

Expressions H13(I . H14)I permit an important physical interpretation. Hamiltonian chaotic dynamics preserves the 
phase volume, i.e. Ff = Fq = T{At). The enveloped or coarse-grained phase volume Ff grows approximately as H19|l . 
The number of states in Ft depends on the definition of a state in the enveloped phase volume. Let one state occupies 
an elementary volume AF. Then the number of states that occupy the volume Ft is simply 

M{t; AF) = ft/ AT = (Fo/AF) exp(/it) < F(Af) /AF. (21) 

Let us emphasize that this interpretation stops working when t^l (in fact, when t > log ^ ^p^^-* ^). 

Now instead of the e-separated trajectories we can introduce AF-separated ones, associated to a partitioning of 
r{M) into elementary cells. Two trajectories will be AF-separated over the time interval t if they do not stay at the 
same cell AFj during t. If the volume of an elementary cell is AF = e^, then 

M{t, AT) = J\f{t, e) = (Fo/e'') exp{ht) (22) 
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and we arrive at the connection 

Ce,t(Ao) = const 7V(t,e) (23) 
We also can introduce an entropy S{t, AT) for the AF-separated states, i.e. 

5(t,Ar) = liiN{t,AT) = In Ce,t(Ao) + const (24) 
with a condition for the states-separation 

Ar = e'' . (25) 

It is essential that the entropy S{t, AT) is defined relatively to a definition of the elementary phase volume AF which 
depends on the system and the type of the evolution process. Non universality of the entropy S{t, AF) will be more 
evident in the next sections where the algebraic complexity will be considered. Here we only would like to mention 
that partitioning of phase space depends on the level of information we want to ignore in the description of dynamics 
and on the level of information we would like to keep about system trajectories. 

A few other comments also are useful. AF-partitioning resembles a procedure of coarse-graining, which is typical 
in statistical mechanics. AF-partitioning is not the same as e-partitioning since trajectories from neighboring cells 
can be arbitrarily close to each other during an arbitrarily large t, although we will never know it. At the same 
time there are common features between AF- and e-partitioning. The formal expressions (|15|l for Ce,t{A) and H22|l 
for N{t,Ar) are the same up to a const (compare to (|23ll . (l25f) '). Both definitions have the same limitation for the 
bounded Hamiltonian dynamics: 

CAA) < T{M)/e' 



A/'(t; AF) < F(Af)/AF. (26) 

The constraints (|26|l do not depend on time. Thus, it follows from (I26() the existence of 

W = tc{e) or t„,ax = ijv(AF) (27) 

such that trajectories or their segments not separated during the i,nax will be non-distinguishable. This property of 
the definitions H15I) .H22 | I eliminates a significant part of the dynamics with non- uniform mixing in phase space. 

IV. COMPLEXITY FUNCTIONS 

The goal of this chapter is to introduce a new definition of a complexity function (CF) rather than just complexity, 
in order to be able to characterize a system with at least two different time scales of a "complex" dynamics. 

A. Definitions 

As before, we deal with area-preserving dynamics of systems in a metric phase space M endowed with a distance 
dist and discrete or continuous time t. The dynamical system /* : M ^ M defines a distance dist{f*-x, f*y) 
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between two trajectories at time t that were initially at points x,y G M. One can also introduce a natural length 
= £{x,f'^x) = £{x,x*) along the trajectory initially at x. We shall need the following definition: 
Two trajectories with initial points x,y Cz A will be (e, i)-indistinguishable if 

dr{x, y) = distifx, fy) < e, < r < i. (28) 

We now introduce a notion of complexity that is based on the verification of divergence of trajectories from fixed 

several ones. We start with a definition of local complexity. 

Consider a small domain A d M with diameters 5a, 5m where 5a ^ 5m, and fix some number e : 5a ^ £ 5m- 
Let us pick a point xq E A and call the corresponding trajectory the basic one. A set Qn — {xk & is said to 

be locally (e, t)-separated if 

(i) For every Xk there is < < t such that 

distir''Xk,nxo)>e (29) 

and 

dist{fxk, fxo) < e, < T < Tfc, (30) 

(ii) for every pair (fe, k'), 1 < k, k' < N, one has 

dist{nxk,n'xk')>e. (31) 

If H31() is not valid then a pair of trajectories corresponding to the pair (fc, k') is e-indistinguishable, and it should 
be treated as one trajectory during the time t. 
Definition 2. The number 

C{€,t,xo,A) := max{A^ | Qat is locally (e, t)-separated} (32) 

is called the local complexity. As a function of t it is said to be the local complexity function. 
A set Qjv is called (e, t)-optimal if it is locally (e, t)-separated and N ~ C(e, t, xq, A). 

It is simple to see that C{e,t,xo,A) < T{M)/e^ and 

C(e, i', Xq, A) > C{e, t, xo,A) if t' > t. (33) 

So, if we are interested in the separation of a bunch Qjsi of N trajectories with initial points Xj G Qn, j — ^, N, 
and their evolution Xj(t) = /*(xj), then after time t wc find out that there are A^o = NQ{e,t,QN) e-separated (from 
the basic one) trajectories- denote this set by Qnq- and N — Nq indistinguishable (from the basic one) trajectories 
(see Fig. 

If Qno is locally separated then we obtain an estimate 



No{e,t,QN) < C{£,t,xo,A). 



(34) 
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(e, t)-distinguishable 



r(M) 



FIG. 2: Example of the evolution of 10 trajectories from the set A of the size jj e during time t. The optimal (maximal) number 
of (e, t)-separated trajectories A'^ = 9. Diameter of all 9 domains of T{AI) is e. Te initial bunch Qat has 10 trajectories with 
A'^o = C(e,t; xo, A) = 4 of the (e, f)-separated ones. Two top examples show the process of evolution that makes a pair of 
traj ect ories (in) distinguishable . 




If, in addition, Qno is (e, t)-optimal then 

No{e,t,QN) = Cie,t,xo,A). (35) 
From physical point of view it is natural to put the following restriction 

No{e,t,QN)<Af=^^. (36) 

See Subsection D of Section 3. 

Now consider a partitioning of the full phase volume M by a set of domains Ak M = UkAk, and in each Ak select 

(k) (k) 

points Xq that make a set of basic trajectories Bk : Xq ' ^ B. Let us assume for the sake of definiteness that 

dist{x''o \xi'''^) > 2e, k' . (37) 

Because of ()37|l , every two points belonging to e-neighborhoods of different basic points are (e, t)-separated for any 
t > 0. 

We consider the finite set Qn = {xj}jLi, ^ 1. Every point in Q^v belongs to the one of sets Ak, so we have a 
partition Qn = ^kQ^^ , Qat n = Q^^\ 

We call the set semi- locally (e, t)-separated, or simply (e, t)-separated, if every is locally (e, t)-separated 
(with respect to the basic point Xq*^"*). 

Definition 3. The number 



C{e,t,B,{Ak}) := max{A^ | Qn is (e, t)-separated} 



(38) 
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is called the semi-local complexity, or simply complexity. As a function of t it is said to be the complexity function. 

If wc choose N^^'f initial points at each set Ak and consider iVg'^-' = NQ''\e,t, xll^\ A/-) of them corresponding to 
trajectories (e, t)-separated from the basic one, then we may form the sum 

^N^''\e,t,x^^\Ak)<Cie,t,B,{Ak}). (39) 

If these Nq'^ points form an optimal set for every k then this inequality becomes the equality: 

C{e, t, B, {Ak}) = 5^ iV^'^^ (e, t, 4^=^ ,Ak). (40) 

Ak 

The complexity functions C(e, t, xq, A) and C(e, t, B, {A/-}) show a level of time-proliferation of e-separated trajec- 
tories from the initial set of a large number of indistinguishable points. 

If we are interested in the only typical (for some measure) orbits we may adjust definitions above to this situation 

by assuming that Qn always consists of typical points for this measure and the points .Tq'^'' arc also typical (see below). 

One of the main points we are interested in is behavior of complexity functions in a neighborhood of the sticky set. 
It is well-known that a "standard" trajectory in chaotic sea behaves in the intermittent way: after relatively short 
chaotic burst it is attracted to the sticky set for a long time, then comes back to mixing part of the chaotic sea, etc. 
If our consideration is restricted to a neighborhood of one (or several) basic orbit, then fast separated pieces of orbits 
correspond to a mixing type of behavior and their initial points are situated much "far" from the sticky set than initial 
points of slow-separated pieces of orbits. By using this observation, we may eliminate fast-separated points (sec the 
next section) i.e., in fact we may choose such initial points in Qn which practically belong to the sticky set. In other 
words, we may in principle calculate local and semi-local complexity of a measure concentrated on the sticky set. 

More rigorously, assume that an invariant measure /x is given. Then in definition 2 we consider only sets Qn = 
{s^iljLi such that 

(i) Qjv is locally (e,t)-separated; 

(ii) Xj e supp{ii) r\A,j = l,...,N, 

(where supp{ij) is the smallest closed set of full measure i.e., the set on which the measure /x is concentrated). The 
maximal number of elements in such sets Qn will be called the local (e,t)-complexity of measure /x. We denote it by 
C^{e,t,xo,A). 

Similarly if in definition 3 we consider only sets Qn containing points from supp{iJ.), then we obtain the semi- local 
(e,t)-complexity of measure /i, C^(e, {Afe}) 
It is useful to introduce the following quantity 

P^{e,t;At,xo) = j^[C^{e,t + At, xq, A) - Ci,{e,t,xo, A)] ^ Pi,{e,t,xo)At, (41) 

where N = C^(e, t, xo,A). This quantity gives a probability to diverge by distance e from the basic orbits during the 
time interval [r, r -|- At], and p^(e, t, xq) is the corresponding probability density function. 
Similarly, 

P^(e, t; At, B) = ]-AC^{t, t + At, B, {Au}) - C^{e, t, B, {Au})] « p^{e, t, B)At (42) 
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gives the probability to diverge from basic orbits going through B during the time interval [r, r + At], and Pp(e, t, B) 
is the corresponding probability density function. 

B. Calculation of the local complexity function 

From now, we will choose initial points Xj in Q at in such a way that the distances between Xj and the basic point 
xo are the same for all j, and we denote it by 5 Moreover, for the sake of simplicity we omit the argument A in 
C(e, t, XQ, A) and {A^} in C{t, t, B, {Ak}). So C(e, t, xo) = C(e, t, xq, A) and C(e, t, B) = C(e, t, B, {Ak}). 

(k) 

As usual in numerical simulations we will assume that randomly chosen points xq, a^Q and Qn are typical with 
respect to some measure fi we are interested in. 

The values of A'o in l|34|l . (|35|l and in H39|l . (|4()|l depend on the choice of S,e, xq (or B) and Q^r. 

The smaller is 6, the longer t should be considered until the maximal values of C{e,t,B) or C{e;t,xo) will be 
achieved. This makes the limit S fairly simple. Understanding a way to work with the parameter e is more 
complicated. Consider one trajectory x* that starts at x and has a natural length £ — £{x, x*). Let t be fairly big and 
select a set of points Xk along a trajectory and, approximately, almost uniformly distributed. We can operate with 
points Xk in the same way as with the basic points x''^^^ in (|4()|l . As a result, we obtain the quantity 

C{e;t,Xk)=No{e;t,Xk)<^^ (43) 

where points Xk belong to the same trajectory. That means that while C'{e;t,x) characterizes the e-divergence from 
X during t, C(e; t, x^) characterizes the e-divergence from x^'- points x are taken in different places of the phase space 
and points Xk are taken along the only trajectory. It is natural to believe that for an appropriately typical set of 
X ^ M and of Xk G £{x, x^) and fairly large t, the equality 

C{e]t,x) ^C{e]t,x), t ^ oo (44) 

holds where subscripts k are omitted. This equality can be treated as an analog of the ergodic theorem. 

A corresponding simulation for C{e]t,x) was performed in [LZ] for a system of tracer dynamics in the field of 
point vortices. The basic trajectory was created by a tracer, and a few "host tracers" were considered within a small 
distance ~ 5 from the basic trajectory. Each time, when a host tracer moves at a distance e from the basic one, it 
was removed and replaced by a new host tracer at a distance 5 from the basic one (Fig. |2J). 




FIG. 3: e-separation from the basic trajectory. 



The scheme of calculation of C(e;t, x) is similar to one used for calculation of the Lyapunov exponents, except for 
some details: 
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(a) the value of e was much less than the distance typically used to evaluate the Lyapunov exponents; 

(b) trajectories of some tracers were e-separated after a very long time. Just these trajectories correspond to events 
of our main interest and their statistics was collected. 

(c) the scheme of obtaining of C(e; t, x) provides simultaneously two different distributions; "probability" C(e; t, x) 
to have e-separation at time t, and C{e; £*, x) as a "probability" to have e-separation after the travel over natural 
length along the trajectory. Both of these probabilities cannot be obtained by a simple transformation of 
variables t = t{£) since the trajectories can be of a fractal type and the variables may not be transformable. 
These necessitates to use more general distribution than C{e;t,x) or C{e,t,x). This will be fulfilled in the 
following section. 

C. Complexity function and exit time distribution 

The heuristic consideration of the previous section can be formalized in a more accurate way and linked to the 
distribution function of exit time. Let us return back to the set A with a basic trajectory that starts at a; G ^, and let 
A^^t be the set of e-separated during the time interval (0, t) trajectories. Assume that the system (/*, M) is transitive 
and the semi-orbit 

£ = U~ o/"a; (45) 

is dense in M : £ = M. It follows from that: 

Proposition 1. For any f ;» 1 there is 5 > such that for any y £ M there exists x & £ such that if dist(a;, y) < 6, 
then dist{x'',y^) <e,0<T<t. 

Proposition 1 states the existence of the indistinguishable trajectories, and the e-separation of orbits can be inter- 
preted as an exit time event of y* from the 5- vicinity of C, {6 ^ e). Let Ct be a piece of the basic trajectory {x,x*) 
with the length £t = £{x,x*). 

Given this basic orbit £t, one may study a distribution of pairs with respect not only to exit times but also to 
positions in space measured by a coordinate s along the orbit £. Indeed, let us measure the position of the point f^x 
on £ by the coordinate s equal to the length Ir = i{x,x'^) of the piece of orbit £,- with the initial point x and the 
final point Because of the Proposition 1, for an arbitrary point y € M the ball Bs{y) of radius 6 centered at y 
contains at least one point x € C. One may characterize the trajectory {y,y*) by the same parameter s as {x,x*). 

Let Ae,t be a (e, t)-separated set and Xj G A^^t. Fix a coordinate sj of Xj by choosing the initial point at xj to 
start counting Sj. Now, introduce into consideration the pair {Tj,Sj) where tj = T{xj) is the first time for which 
dist{f'^^Xj,f^^x) = e, i.e. the exit time from the e-neighborhood of the basic trajectory £t, and sj := s{f^^ xj) — s{xj), 
the length of the piece of the orbit between the initial and final points. 

For two different Xj and Xk that are close to the basic x and escape from the e-vicinity of x* at close times tj and rj 
one can expect that the orbit segment's length sj, s'j will also be close. But if we take another a; as a basic one, other 
two initial points Xj,x'^ in the (5- vicinity of x such that the e-cscape time for them will be correspondingly Tj, rj, i.e. 
the same as for the initial basic point x, then it could not be that Sj, Sj arc the same. This property is a result of the 
non-uniformity of behavior of orbits in the phase space and, speaking further, it is a result of the fractal space-time 
properties of trajectories. 
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D. Flights complexity function (FCF) 

Consider a small domain A C M, a typical point x G A and a typical close point y G A at (5-distance from x. 
The e-separation of the pair {x,y), e 3> (5 occurs at some time t and distance s — £^ = i{x,x*). Here we omitted e 
as an argument of I. Furthermore, let us remark that the distance s depends on y. But we neglect this dependence 
assuming implicitely that for a typical y at the (S-distance from x the value of s is asymptotically the same. 

The distance s of the (e, i)-separation is said to be the length of a flight, i.e. a length of the path that two nearby 
trajectories are flying together. 

Let us treat x as the basic point and consider the set Qn — {xk}k=i of points (5-close to x. This set is called locally 
(e, t, s)-separated if it is locally (e, t)-separated (see Subsection A) and moreover Sk < s where Sk = £{x,x'^''). 
Definition 4. The number 

C{€,t,s,x) — max{A^ | Qn is locally (e, t, s)-separated} (46) 
is called the local (e, t, s)-complexity. As a function of t, s, it is called the local flight complexity function (FCF). 

Similarly to the definition of C{e,t,B) in H39|l . (|40|l we can consider a collection of flights and their lengths and 
time intervals from different domains Ak : M = UkAk- As a result we have the semi-local FCF 

C(e,i,s,S)=^C(e,t,s,a;f ) (47) 

where Xq''^ G Ak are basic points. 

As in Subsection A we may choose N^''^ initial points in Ak for any fc, select the maximal (e, t, s)-separated subset 
consisting of A^q'^-' (e, t, s) points and form the sum 

Ak 

The sum is equal to the semi-local FCF if initial points form an optimal set. 

As in Subsection C, let us assume that there exists a trajectory C dense in our phase space M. Then, as it was 
said there, every piece of a trajectory (y, y*) lies in an e- vicinity of a piece (x, a;*), x G C, and, thus has the coordinate 
s — £{x, X*). It allows us to extend the notion of (e, t, s)-complexity as follows. 

We say that a set Qn = {xk}k=i t, s)-separated if it is (e, t)-separated and Sk < s where Sk is the s-coordinate 
of the piece {xk,x^f^). 
Definition 5. The number 

C(e,t, s) — max{A^ | Qjy is (e, t, s)-separated} (48) 
is called the flight complexity. As a function of t, s, it is called the flight complexity function. 

This quantity has a simple meaning: let us take a large enough number J\fs of (5-close pairs within M with a fairly 
typical distribution of the initial conditions Xk G M, k — 1, . . . ,J\fs. C(e; t, s) is the number of trajectories that are 
mutually e-separated (e ^ 6) during time t at distance s Therefore C(e, t + At, s + As) — C{e, t, s) is the number of 
trajectories that are e-separated during time t G {t,t + At) at distance s G (s, s + As). 
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One can introduce the function 




+ As)-C{e,t,s)] 



(49) 



where N = C(e, t, s), is called the density of the FCF. 

The main goal of this paper is to connect the notion of complexity with the space-time local instability properties 
of systems. A necessity of such a notion appears due to the specific features of Hamiltonian systems to have chaotic 
dynamics strongly non-uniform in phase space and strongly intermittent in time, and particularly due to the existence 
of dynamical traps [Za2] . 

Let us consider again a small domain A and pick some N trajectories in A with a characteristic distance S between 
them. Due to the instability these A'' trajectories will fill at time t an enveloped phase volume FenvC^; A, > r(0, A, S) 
because of the larger distance between trajectories. After coarse-graining of renv(i;^)'^) we arrive at T{t,A) ~ 
rf.nv{t;A,6) but without empty space ("bubbles") presented in rQnv{t;A,5). This is a typical physical situation of 
growth of the coarse-grained phase volume and the problem is reduced to the estimate of the growth. The presence 
of dynamical traps makes the growth of T{t, A) sensitively dependent on all its parameters t, A and S or, in other 
words, expanding of f depends on the initial coordinate and observational time. For example, if A is taken in the 
stochastic sea, f ^ exp(?it) but if A is taken inside a dynamical trap, f ~ f''. 

We need to make the only step to arrive to our definition of complexity. Indeed, one can consider the phase volume 
partitioning by elementary cells AF and introduce the complexity 



where we use a; as a coordinate of A and e defines a diameter of the coarse-graining and does not enter into any 

physical results. 

The density of the FCF (49) can now be considered as a distribution function of having displacement s at a time 
instant t and the corresponding entropy can be easily introduced (see the next section). 
One more useful connection appears from the expression 



C{e, t; x) = const. r(e, t; x) 



(50) 




(51) 



that is a probability to be trapped in a tube of the diameter e supported by the domain A during time t. 
Respectively 



Pesc(e,i; A) = l-Ptr{e,t;A) 



(52) 



is a probability to exit from the tube during some time > t, and for f — > oo and 



esc 



we arrive at 



(53) 



of the probability density to return to any small domain A with 



7 = min (3{A) + 1 



(54) 



and no dependence on A. Due to the Kac lemma 7 > 2 for the bounded Hamiltonian dynamics. 
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In this chapter we considered the case of continuous time. But all ideas, definitions and results can be generalized 
to the case of discrete time. One can choose different analogues of the length of the piece of an orbit- for example 
in an euclidean space one may consider the length of union of segments joining consecutive points of the orbit. The 
main ideas are independent of the choice of the definition of the lengths. 

V. ENTROPY 

The function C(e; t, s) characterizes local e-divergence of trajectories and it can be considered as a new characteristic 
of the dynamics. Its main role is to describe evolution of a typical pair of orbits taken apart of a small distance S. 
Let us show how the C(e, t, s)-complexity works. 

A. Complexity and entropy 

Following a general physical approach let us define 

5'(e,t,s) = In C(e,i,s) (55) 

as (e, i, s) -entropy of the dynamics since C{e;t,s) is a number of (e; s)-separated states. Physically speaking, due 

to (|43|l the number of separated states cannot be more than = r(Af)/e^ (compare to ()36|) . i.e. for the ergodic 
dynamics 

5(e, i, s) < InA/". (56) 

Due to a mixing property in phase spaces or, more specifically, due to an instability and separation of any initially 
close orbits, one can expect the growth of S{e; t, s) with time until the max S = In A/" is reached. The definition H55(l 
permits to estimate from C{e,t,s) some fine properties of the evolution of S'(e,t, s) as a function of time t and the 
length of separation S. 

B. Examples 

For the case of the Anosov-type systems 

s = s{t) = s(0)e''*, (57) 



i.e. s has a "good" dependence on time and it may be expunged from C(e, i, s). Then 

C(e;i,s)^C(e,t)= f-) e''* (58) 



where s[fi) — 8 and H58|) coincides with (|15|) (and the arrow means "is completely defined by"). Similarly 



S'(e; t,s) ^ S{t,t)= In C(e, i) = & In i + + const (59) 

e 



and we arrive to the standard expressions 



h = — = const 

at 
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dS(e,t) , , 

which deliberately are written in the form of partial derivatives. 

Consider fully opposite case of an intcgrable system in the annulus K = {{9, r), < 6 < 2tt, 1 < r < 2}, defined by 
the equation 

f = r , e ^0 + r, mod 2tt (61) 

i.e. the map T : K ^ K is T{r, 9) = {r,6 + r). Let us calculate Ce,t{A) where A is the interval 6 — 9o, 1 < r < 2. 
Since T'^{r,6o) — {r,9o + rt mod 27r), the segments it{ro,'t^o), ^t(^i,^o) are (e, i)-separated iff \rot — rit\ > e, i.e. 
''0 ^ ri\ > e/t. The maximal number of such points on the interval [1,2] is 1/e • t, and hence 

C,,M) - - (62) 
e 

Since the number of e-different sections 9 — 9q on the interval [0, 2tt] is then one has 

CeAK) ^ 2n ■ e-^ ■ t (63) 

Thus, integrable nonlinear system on the annulus is a system with linear growth of complexity. By the way, 6 = 2 is 
the dimension of the annulus. 
The corresponding entropy is 

S'(e,t) = lnt-21ne + const (64) 



and 



dt 

This shows that in a polynomial case it is possible to consider the expression 

dS{e,t) 



-0, (t-.oo) (65) 



(66) 



dint 

(equals to 1 for (|64|l ) which provides the information on the frequency (equals 1) of the rotation in the annulus. 

There are many other less trivial systems for which growth of complexity is subexponential (billiards in polygons 
interval exchange transformations, etc.). 



C. Polynomial complexity and anomalous transport 

Complexity defined in H58() grows exponentially with time reflecting an existence of a positive Lyapunov exponent 
and exponential divergence of trajectories in phase space. This is not the case for zero Lyapunov exponent systems 
and for diffusional type processes. To consider large scale processes such as the diffusion for systems of that kind, let 
us use the partition function Af{t, AT) 



7V(t, AF) = const. C(e,t) 



(67) 



18 



with a normalization constant that can be chosen in such a way that 

7V(i,Ar)^l, t^oo (68) 

In numerous cases the process of mixing in phase space and the corresponding separation of trajectories has algebraic 
dependence on time. Particularly, it is related to the dynamics with the fractal time [. . .] and the diffusional type of 
processes. For this case, the complexity is polynomial in time and 

M{t, AT) = const. • {t/tof ^ const. • C(e, t) (69) 

with some exponent /? and characteristic time scale to ^ t- As in H66|l . the entropy growth rate can be defined in the 
Int scale 

^^^^^ 

and the exponent f3 characterizes the corresponding rate of the entropy growth. As it appeared in [...], chaotic 
dynamics of real Hamiltonian systems does not display, in general, exponential growth of the complexity, and the 
number J\f of e-separated orbits grows asymptotically as polynomial in time and the length of separation s ~ ln{x, a;*). 
In this case the complexity can be written as 

C{e;t,s) = {so/sr{t/tofg{e;s,t) (71) 

where sq, to are characteristic scales of length and time, a, > 0, and g{e] s, t) is a slow varying function. We will be 
interested in the limit 

s/sq^oo, t/to ^ oo. (72) 

The limit H72|l corresponds to the increasing of the number of e-separated states with the growth of time and decreasing 
of this number with the growth of the separation distance. For example a = 1 and /3 = 1/2 correspond to the normal 
one-dimensional diffusion, while other powers appear for the anomalous diffusion. 
Following the definition 155|1 let us introduce the (e; t, s)-entropy: 

S{e;t,s) = lnC{e;t,s) = -a ln(s/so) + /3 ln(t/to) + ln5(e; s, t) (73) 

This expression will be analyzed in the next section. 

Here we would like to mention that the complexity in the form H71|l suggest that the corresponding partition function 

Af{e; t, s) = const. C(e; t, s) = coiist.{t'^ / s°')g{e; t, s) (74) 
has a self-similar dependence on (t, s) in the limit H68(l . and consequently for its moment we have 

(s") ^V-t^ (75) 
with D that may depend slowly on t. The equation 1)75(1 describes the anomalous diffusion with the transport exponent 



fj. = 2fi/a 



(76) 
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that can be obtained from 

((s"))2/" _ (77) 



(see more in 




The new parameters a, f3, and /i can be considered as new dynamical invariants intimately linked to the (e; t, s)- 
complexity and the corresponding entropy. Their interpretation is given in the next section. 

D. Mixed complexity and the entropy extensiveness 

Dependence of the (e; t, s)-complexity on two variables s and t makes it possible to have "mixed" complexities of 
the following types: 

C^^\e;t,s) = e^^-{t/tofg^'He;t,s) (78) 

i.e. algebraic in one variable and exponential in the second one. The case C^^^ {e;t, s) shows exponential divergence 
in time and a fractal length structure with a box dimension a. The case C^^-* (e; t, s) does not have yet analogy or 
physical interpretation. 

Similar definitions can be done for the entropy: 

S^'^\e;t,s) ^lnC^^\e;t,s) (79) 

On the basis of all definitions of entropy we can make an important remark about its extensivity. Typically, the 
extensivity is considered with respect to the coordinate variable in statistical physics. Dynamical systems analysis 
provides an extensivity with respect to the number of degrees of freedom, or with respect to time. Here we would 
like to mention that instead of t,s can be \nt or Ins, or different combinations. For example, in the case of C"(^) 
the entropy C'^^-' is additive in the space of variables (lns,i) while in the case (|71|) the entropy is additive in space 
(Int, In s). 

Our final remark for this chapter is that (e, t, s)-complexity is considered for a system with evolution and it may 
happen very typically, that there are two time intervals: at the beginning the evolution of the complexity is exponential 
and, after a fairly long time it becomes algebraic [ENZ]. Similar pattern occurs for the Sinai billiard where a distribution 
of the Poincare recurrences follows exponential law for the beginning and then decays as ~ 

VI. TRAVELING WAVES AND RIEMANN INVARIANTS OF ENTROPY AND COMPLEXITY 

Consider new variables 



e = ln(s/so) , V = Ht/to) 



(80) 
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and rewrite H71|l as 

%t,s) = (-< + /37/)5(e,C,r;) (81) 

where g is the slow function of ^, 77. Neglecting the derivatives of we can conclude from (|81|l that the entropy is 
constant along the traveling wave-front 



where c is the wave speed. Due to (|7S)l 



^ = (/3/a),7 EE C77 (82) 



/I = 2c (83) 



and the transport exponent can be interpreted as the double speed of the traveling wave of the entropy or complexity. 
This property appears because of the nontrivial coupling between time and phase space of dynamical systems. Indeed, 
any kind of randomness, which is assumed for kinetics in stochastic field, differs from the randomness of chaotic 
dynamics since the randomization of trajectories occurs as a result of nonlinearity and dynamical instability. 

The structure of the entropy H81|) or complexity function H71(l is invariant, with respect to the renormalization of ^ 
and 77, namely 

s^XsS , t-^Xtt , (84) 

if we neglect variations of g{e; ^, 77), and if A^, At satisfy the equation 

^/2 = c = /3/a = lnA^/lnAt (85) 

Equation (|85|l shows a connection between parameters a, (3 of the dynamical origin, transport exponent /i, and velocity 
c of the traveling wave of the complexity. The parameter c also defines a direction in (i, s) coordinates of the traveling 
wave propagation or, in other words, directional complexity and entropy. For different dynamical models scaling 
parameters As, At were defined in [ZEN, KZ, BKWZ]. 

In fact, (a, [3) or (As, At) are not constants, and wave propagation can be in different directions. This situation is an 
analog to multi-fractal space-time structure. For any direction with "velocity" c in (^, rf) space, there is a correspond- 
ing curve in (s,t) space and an isoline of the section of the surface S{t, s) by a plane S{t, s) = const. The fractional 
exponents [a, j3) of the complexity space-time dependence are receiving a new meaning as entropy/complexity char- 
acteristics 

dS d\nC dS ainC ^ , , 

along which the traveling waves have a constant velocity. In this way we have a generalization of the usual notion 
of entropy for a finite system. This analogy can be advanced further by comparing waves of complexity/entropy to 
simple waves in fluid dynamics. Then the velocity c is the Riemann invariant and so is /i. 

We arrive to an interesting conclusion: the transport exponent /i can be interpreted as a Riemann invariant of 
the complexity (entropy) simple wave in the (i, s)-space. In the following chapter it will be discussed a possibility 
of anisotropic phase space with different values of in different directions. Correspondingly, we will have different 
Riemann invariants. 
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VII. DIRECTIONAL COMPLEXITY AND ENTROPY 

The case H71|l . (17311 of the self-similar behavior of the complexity function shows explicitly that the entropy can be 
written in the form 

S{e;t,s)^S{^~cij) (87) 

up to a slow varying function g. The expression H87(l permits to consider joint space-time variables as a 2-dimensional 
space rj) where entropy propagates along a line in the direction with tangent c. As it was mentioned in the previous 
section, it can be different Riemann invariants and so is for Ce where e is a unit vector along some direction. 

A. Definitions 

To formalize the notion of the directional complexity and entropy, let us use an idea of Milnor [M1,M2] for con- 
struction of directional windows in space-time (see also [ACMF]). Consider dynamical systems generated by a map 
/ : M"^ M'^, the d-dimcnsional Euclidean space. Denote by a compact subset of M"^ and by e a unit vector in 
IR"^ X M such that the projection of e onto the last coordinate axis is non-negative. Given T e _K let Wr.e denotes 
the following window in IR'^ x IR: 

Wr.e --^ {y e M"^ ,t £ R,y ^ X + te,x E W,0 < t < T} . (88) 

For example if = 1, e = (cos 6*, sin 6*), 9 G [0,7r], then 

WT,e = {(a;-|-icos6i,isin6'),0 <t <T,x eW} (89) 

If d = 2, e = (cos a, cos /?, cos 7), cos^ a + cos^ f3 + cos*^ 7 = 1, then 

Wr.e {{xi -HicosQ;,X2 H- i cos^, i COS7), (a;i, 0:2) e W,0 <t<T}, (90) 

Let us generalize the Definition 2 in Section (|IV A|l of the e-separability of orbits as their distinguishability through 
the window Wt.b- 

Definition 6. Two orbits {/"a;} and {/"y}, x,y G W, are (e, WT,e)-separated at time T if {f"-x,n) G 
WT,e, {f^y, n) e Wr.e and dist(/"a;, f"y) > e, where dist is the distance in M'^. 
Now we may define the maximal number of (e, WT,e)-separated orbits: 

Ce{WT,e) — max{#/C : /C is an (e, Wr.e) — separated set} (91) 

and call it (e, T)-complexity in the direction e. 

Of course, the complexity depends on the set W of initial points. But the rate of its growth with T may be 
independent of W. If this growth is exponential we may define the directional topological entropy. 
The topological entropy in the direction e is defined by 

ife = lim supISt_oo^ l0gC,(WT,e) (92) 
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where supremum is taken over all compact subsets W of M'^. 

Note that the hmit in e exists since Ce(WT,e) is a nondecreasing function of W and e. Moreover He £ [0,oo]. For 
some systems it may happen that He = oo. In this case we may compute the following quantity. 
The density of topological entropy in the direction e is defined by 

he = lira limv^oo:^ ( sup (limT— 0077; log C<:(H/T,e) ) (93) 

e^O W<V \ T J J 

Let us remark that definitions of directional topological entropy and its density in [ACFM] is similar to the Defini- 
tions above. 



B. Two Examples 




FIG. 4: Distribution of displacements P = P{R,t) for the web map {R^ — + v^) shows the complexity traveling waves. 



Here we show two numerical examples that demonstrate the existence of the directional complexity and com- 
plexity/entropy traveling waves. Both examples are for the web map of 4th-fold symmetry [Z]. The map acts in 
(m, u)-space: 

w = w, v = ~u^KsuYv (94) 

with a parameter K and u,v € (— cx), 00). It was shown in [WZ] that transport exponent /i can be different in 
different directions of (u,w)-space (see Fig. QJ. Depe ndence of transport exponents on the the direction also appears 



to be recognizable for tracers in a 3- vertex flow KZl |. After we have made a link between the (e; t, s)-complexity and 
transport, one may expect that the presence of the directional anisotropy indicates the anisotropy of the complexity 
and entropy as well. More accurately we should say that for an infinite dense set of values of K the trajectories 
are sticky to some islands and, due to that, the distribution function has power tails [ZEN]. We assume that the 
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complexity function should be of the polynomial type for these cases. Different transport exponents for different 
directions in such a case were demonstrated in [WZ] by simulations (see Fig. EJ. 




FIG. 5: The contour plot P(R,t) — const, for the same distribution as in Fig. 4 shows the lines of the wave propagation. 

Figure 13 provides more information since it shows in 3-dimensional plot a dependence of the normalized number of 
trajectories P — P{R, t) as a function of their position R at time instant t in the log-log-log scales. The plot clearly 
indicates directional waves as ripples of P. Figure El shows different slopes of the isolines P = const that correspond 
to different velocities of the wave propagation. 

C. Directional complexity and rotation intervals 

For dynamical systems in the circle rotation numbers reflect some properties of behavior of orbits in space-time. It 
is interesting to study their relation to directional complexity. For that we consider the map F : R ^ IR oi the form 

F{x)=x + LO + k(l){x) (95) 

where is a 1-periodic smooth function such that < 1 and fc > is a parameter. If fc < 1 then F is one-to-one 
and the map F(x) mod 1 can be treated as either a continuous map of the circle or a piecewise continuous map of 
the interval [0, 1]. We choose the last interpretation. 

For fc = we just have an interval exchange transformation of the interval. For < fc < 1 this transformation 
becomes nonlinear but topologically very similar to that for fc = 0. 

Consider the case fc = more carefully. The orbit Xn — F'^xq for fc = satisfies the equation 

Xn ^ xq + nuj. (96) 

Therefore the rotation number of the map F equals lim„^oo if ~ ^- window Wt.goi go — (cos 0o, sin^o), 

tan^o = ^1 there are points (x„,n) for any n > 0, but if e = (cos 0, sin 0), tan0 ^ lo, then for any fixed e > there 
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FIG. 6: Time dependence of the second moment for the web map shows different slopes with transport exponent /i — 1.25 
along the u-direction and fi = 1.50 along the diagonal direction [WZ]. 



is A'' > such that there are no points (a;„,n), n > N, in this window. More precise, if e 7^ Gq, W = [0, 1], then 
Ce{WT,e) = Ce{WTo,e) for all T > Tf) = ^^_l^^^g^ , and the set WT,e\WTo,e does not contain points (a;„,n), xq e W, 
To < n < T. If e = Go then the set WT.e\W^To,e contains points n) for any n < T but the complexity Ce(WT.eo) 
is still bounded; in fact, C^iWr. 



1 



eo I 



The case < A:, 1 is similar to the just described one and we omit its consideration. 

Now let fc > 1. We consider the r otation inte r val of the map F ^ i.e. the set of accumulation points of sequences 
for all X E M, (see for instance ALM |. Ke|, Mai [l. This interval can be nontrivial, say [[x)i,[x)2], ^2 > ^1, and 
for every . e there is an infinite F-invanant set A. such that . e A. implies hm„_ = Moreover 

A„ may contain uncountably many points f |Ma2| ). Trajectories in Ai^ may behave chaotically and the complexity 
Ci{WT.e), e — {cos9, sm9), ta,n9 ^ u, may grow exponentially with T, i.e. He > 0. 

But if tanO ^ [wi, 0^2] then CeiWr.e) will be bounded (as above) and He will be 0. Thus the behavior of directional 
complexity has nontrivial dependence on the direction in space-time. 

The authors of SY] studied observable values of rotation numbers. They found numerically that even if A; 3> 1 
one is able to observe the only one (or a small number) of rotation numbers corresponding to preferable directions in 
space-time. 



VIII. CONCLUSIONS 



Nonergodicity of phase space of Hamiltonian dynamics is due to the presence of islands. The boundaries of the 
islands are sticky and this imposes strong nonuniformity of the distribution function in space and in time. Such 
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properties of the dynamics necessitates a new approach to the problem of complexity, entropy and related notions of 
the unstable dynamics. In this paper the notion of complexity function is introduced as a characteristic number of 
mutually e-separated trajectories during time t. This notion resembles the similar features as a propagator function, 
i.e. it depends on the initial and final space-time. In fact, the complexity function shows how fast trajectories disperse 
from each other due to the local instability properties of a system. 

The entropy can be introduced in a natural way as a logarithm of the complexity function but the choice of variables 
can be different depending on the type of local instability. In this way we were able to include into the same scheme 
systems with strong intermittency and systems with zero Lyapunov exponent. 

In this article we introduced local and semi-local and flight complexity functions that can be calculated for specific 
systems. The question arises: why do not try to calculate just e-complexity function and work directly with it? We 
think that this is impossible. The main reason becomes clear from the following consideration. 

Fix n ^ 1 and assume that we found an optimal set Qn = {^k}^=i, ^ = C!{e,n), of initial (e, n)-separated points. 
If we are interested in the complexity function C(e, n) as a function of n, then, say, for n' < n we either need to find a 
new optimal set or to use points in Qn- Of course the second option is preferable. So, the problem appears: knowing 
that Qat is (e, n)-separated, select the maximal subset in Q^r that is (e, n')-separated. 

Let us reformulates this problem as follows. Define the graph G with vertices (xi, ...,xn) such that the edge {xi, Xj) 
exists if and only if the points Xi and Xj are (e, n')-separated. The problem is to find a subgraph of G with maximal 
number of vertices such that every two vertices of this subgraph are connected b y an edge. This is the well-known 
Clique Problem which is happened to be so called NP-complete (see for instance |GJ|). Specialists believe that NP- 
complete problems have no good algorithms, i. e. one can not solve such a problem by using best computers even for 
not so large values of n' . 

We see that the problem of calculation of e-complexity functions is very closely related to NP-complete problems. 
It is one of reasons why we introduce local and semi-local complexities. 
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